Analysis of MCMC algorithms for Bayesian linear regression with Laplace errors

Let π denote the intractable posterior density that results when the standard default prior is placed on the parameters in a linear regression model with iid Laplace errors. We analyze the Markov chains underlying two different Markov chain Monte Carlo algorithms for exploring π. In particular, it is shown that the Markov operators associated with the data augmentation (DA) algorithm and a sandwich variant are both trace-class. Consequently, both Markov chains are geometrically ergodic. It is also established that for each i ∈ {1, 2, 3, . . . }, the ith largest eigenvalue of the sandwich operator is less than or equal to the corresponding eigenvalue of the DA operator. It follows that the sandwich algorithm converges at least as fast as the DA algorithm. AMS 2000 subject classifications. Primary 60J27; secondary 62F15 Abbreviated title. MCMC algorithms for Bayesian linear regression